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Introduction 

Prostate  cancer  is  the  second  most  common  cancer  occurring  among  American  men,  with  241,740 
men  diagnosed  in  the  United  States  in  2012.  Increased  screening,  such  as  using  serum  prostate- 
specific  antigen  (PSA)  and  extended-template  transrectal  ultrasound  biopsies,  have  led  to  the  earlier 
detection  and  staging  of  patients,  but  clinical  management  of  the  disease  remains  difficult.  This 
difficulty  is  primarily  due  to  the  biological  diversity  in  prostate  cancers,  which  often  arise  from 
multiple  sites  in  the  prostate.  A  major  challenge  in  the  field  of  prostate  cancer  is  to  correctly  identify 
if  a  cancer  is  aggressive  and  dangerous  for  the  patient  and  if  the  cancer  will  or  will  not  impact  the 
patient's  quality  of  life.  Currently,  prostate  cancers  are  classified  from  biopsies  after 
immunohistochemistry  using  a  modified  version  of  the  Gleason  Grading  System.  It  is  also  important 
to  monitor  the  aggressiveness  of  cancer  cells  during  biological  experiments  in  tissue  slices  for 
example  to  study  the  efficacy  of  a  new  treatment  in  vitro.  It  is  thus  imperative  to  develop  a  new 
microscopy  method  that  can  provide  a  measure  of  cell  activity. 

The  purpose  of  the  work  is  to  provide  an  optical  tool  to  measure  the  local  metabolism  in  live  tissue 
slices  for  biological  studies  of  treatment  efficacies.  We  aim  at  developing  an  optical  microscopy 
method  that  can  provide  supplemental  information  based  on  the  local  metabolism  of  cells  within  the 
tissue. 

Our  main  hypothesis  is  that  the  locally  resolved  metabolism  of  cells  is  a  robust  indicator  of  the 
malignancy  of  the  cancer.  The  Warburg  effect  predicts  that  the  metabolism  of  cancer  cells  differs 
from  the  metabolism  of  the  other  cells  in  the  prostate  tissue  in  such  a  way  that  cancer  cells  use  more 
glucose  than  normal  cells  [1,2].  This  effect  is  exploited  in  positron  emission  tomography  (PET) 
imaging,  where  cancer  cells  are  imaged  due  to  their  higher  metabolic  rate  of  radiolabeled  glucose, 
such  as  fluorodeoxyglucose  (FDG).  Clinically,  this  hypothesis  could  have  broad  implications  for 
studying  the  efficacy  of  treatments.  However,  a  current  limitation  is  that  the  uptake  of  FDG  cannot 
be  resolved  within  individual  cells  using  conventional  instrumentation  such  as  PET,  autoradiography, 
and  scintillation  counting.  However,  the  technology  that  will  be  developed  over  the  course  of  this 
project  will  be  able  to  provide  the  required  resolution. 

The  rationale  for  our  hypothesis  is:  tumor  cells  take  up  more  glucose  when  compared  to  normal 
tissue.  This  effect  has  been  used  to  enable  PET  imaging  and  significantly  increased  glucose 
metabolism  in  cancers  correlates  well  with  higher  histologic  grades  and  poor  survival  [3,4], 
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Timeline 

This  reports  is  the  first  annual  report  of  the  two  year  project  (months  1-12).  For  a  better  understanding 
of  the  progress,  we  reproduce  the  work  statement  summary  at  this  point.  We  have  colored  all  achieved 
objectives  and  tasks  in  green. 


Task 

Month  1-6 

Month  7-12 

Month  13-18 

Month  19-24 

Objective  1:  Design  of  a 
radioluminescence  microscope  for  the 
imaging  of  FDG  uptake  in  Prostate  tissue 
slice  cultures  (TSCs). 

Task  1:  Set-up 

Task  2:  Algorithm 
Task  3:  FDG  calibration 
Task  4:  FDG  imaging  in  TSCs 

Objective  2:  Comparative  measurements 
of  FDG  uptake  into  prostate  TSCs  of 
Gleason  Grade  3  and  4/5  in  vitro. 

Task  7:  Correlation  algorithm 

Task  8:  In  vitro  FDG  imaging  in  TSCs 
Task  9:  Statistical  data  analysis 


Objective  3:  Proof-of-concept 
measurements  of  the  cell  metabolism  in 
live  TSCs  during  radiation  treatment. 
Task  12:  FDG  imaging  with  irradiation 
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Key  Research  Accomplishments 

Objective  1:  Design  of  a  radioluminescence  microscope  for  the  imaging  of  FDG  uptake  in 
prostate  tissue  slice  cultures  (TSCs). 

Task  1: 

We  successfully  built  an  inverted  fluorescence  microscopy  platform  to  image  the  FDG  distribution  in 
TSCs.  To  image  the  FDG  content  on  a  single-cell  level,  we  turn  to  RLM,  which  is  presented  in  Ref.  [5] 
(Fig.  1).  The  advantage  of  the  technique  is  that  decays  are  converted  to  an  optical  signal  close  to  the 
origin  of  the  decay,  which  enables  decay  detection  with  single-cell  resolution.  Live  cells  are  sparsely 
cultured  on  a  glass  coverslip  and  are  incubated  with  FDG.  RLM  utilizes  a  thin  scintillator  plate,  which 
is  in  contact  with  the  cells  of  interest,  to  convert  ionizing  radiation  from  emitted  beta  particles  into 
visible-range  photons  detectable  in  a  sensitive  microscope.  The  optical  scintillation  signal  can  be 
measured  with  an  EM-CCD  camera  with  high  resolution  and  enables  minute  radiotracer  detection. 
An  optimized  set-up  produces  the  while  light  cell  image  and  the  corresponding  RLM  image  in  Fig  1  B 
(Task  lb). 


A  Radioluminescence  Microscope 


B  Optical  reconstruction  of  the  beta-ionization  track  (ORBIT) 


Figure  1.  Schematics  of  the  radioluminescence  microscope  and  image  reconstruction.  (A)  A  decay 
event  of  the  18  F  atom  in  the  FDG  will  generate  a  P-particle,  which  will  travel  up  to  100  pm  in  water. 
The  scintillator  will  generate  visible  photons  along  the  trajectory  of  a  P-particle,  which  are  collected 
by  a  high  NA  microscope  (Olympus  LV200).  (B)  The  radioluminescence  image  was  obtained  by  our 
methodology  called  "optical  reconstruction  of  the  beta-ionization  track"  (ORBIT)  as  described  in  detail 
in  Pratx  et  al.  [6]  and  in  the  methods  section.  Individual  decays  are  imaged  with  a  high  acquisition  time 
and  their  center  of  mass  is  recorded  to  build  up  a  2D  histogram  of  decays,  which  is  the  digitally 
reconstructed  FDG  image. 


We  also  compared  the  performance  of  new  thin-film  scintillators  (LU2O3)  to  the  performance  of  the  thicker 
standard  CdW04  scintillators  (Task  lc).  The  data  is  shown  in  the  following  table  and  figure  2: 
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Scintillator  type 

Light  yield 
[photons  fceV 

Emission  maximum 
[nm] 

Effective  Z 
(atomic  number) 

Total  stopping 
powEr1'  |MeV  cm  ’] 

Hygroscopic 

Thickness 

M 

Density 
[gon  ^ 

Luj  Q  :Eu 

4S 

610 

67.1 

21.4 

No 

6-10 

9  3 

CdWQ*  12—1 5 

4*0 

64 

13.0 

No 

500 

7.9 

"'Stopping  power  given  far  1 00  keV  position. 


Figure  2.  Performance  of  thin  film  scintillators.  (A)  Shows  a  side  by  side  comparison  of  the  thin- 
film  scintillators  (Lu203,  left)  and  the  standard  CdW04  scintillators  (right).  Analysis  shows  a  smaller 
area  of  the  tracks  within  the  thin  film  scintillator,  which  leads  to  a  higher  resolution. 

Thin  film  scintillators  provide  better  image  resolution,  but  the  manufacturing  of  this  material  is  difficult. 
That  is  why  we  will  continue  using  commercial  CdW04  scintillators  for  the  remainder  of  this  work. 


Task  2: 

We  implemented  a  digital  reconstruction  algorithm  to  reconstruct  individual  decays  within  the  sample 
into  a  final  distribution  or  image.  The  method  filters  and  thresholds  individual  images  to  detect  decay 
events  using  a  center-of-mass  location  step.  The  reconstruction  is  shown  in  figure  1  B.  The  parameters  of 
the  thresholding  are  adjusted  every  time  a  new  sample  is  analyzed.  The  false  detection  rate  is  below  0.1%. 


Task  3: 

We  calibrated  the  microscope  using  a  thin  film  of  FDG  in  matrigel.  The  advantage  of  this  method  is  that 
we  know  the  exact  thickness  of  the  film  and  thus  the  imaged  volume  and  activity  in  the  field  of  view.  With 


Gaussian  Fit 


Figure  3.  Image  from  a  homogeneous  distribution  of  radiotracers,  with  the  corresponding  Gaussian 
fit  to  correct  for  the  position  of  an  emitting  object  in  the  field  of  view. 
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the  decay  rate  and  the  profile  of  the  collected  data  we  calibrated  the  microscope  to  be  able  to  report 
measurements  in  Becquerel  (Bq)  and  we  also  correct  for  the  collection  deficiencies  towards  the  border  of 
the  image  by  fitting  the  pattern  of  decays,  as  shown  in  figure  3.  Drift  did  not  manifest  itself  as  a  problem 
during  experiments. 

Task  4: 

With  the  RLM  microscope  we  set  out  to  optimize  the  protocol  for  tissue  imaging.  The  optimized  protocol 
is  as  follows: 


1.  Starvation  of  the  prostate  TSCs  in  glucose-free  media  for  45  minutes. 

2.  Incubation  of  prostate  TSCs  in  glucose-free  media  with  100  pCi/mL  18F-FDG  for  10  minutes. 

3.  Subsequent  rinsing  steps  to  remove  excess  FDG. 

4.  Fixation  in  4%  paraformaldehyde  for  10  minutes. 

5.  Cherenkov  imaging  to  localize  tumors  and  regions  of  interest. 

6.  Cryosectioning  into  8  pm  slices  and  transfer  onto  imaging  coverslip. 

7.  RLM  microscopy 

8.  H&E  staining  of  the  same  section. 

9.  Image  analysis 

The  protocol  and  workflow  is  shown  in  Fig.  4. 


A 


Prostate  biopsy 
core 


/ 


Prostate 
tissue  slice 


Prostate  TSC 
in  bioreactor 


Cryosectioning  with 
microtome 


C 


Radioluminescence  microscopy  (RLM) 


Autoradiography 


Scintillator 


H&E  Staining 


Figure  4:  (A)  Prostate  biopsies  are  taken  following  radical  prostatectomy.  The  biopsy  cores  are  sectioned 
into  200  pm  sections,  which  are  kept  alive  in  a  bioreactor  and  serve  as  a  faithful  tissue  culture  model  [1]. 
(B)  Prior  to  imaging,  tissue  slice  cultures  (TSCs)  are  starved  in  low  glucose  media  and  incubated  in  media 
containing  100  pCi/mL  FDG.  After  rinsing  with  PBS,  the  TSCs  are  sectioned  into  8  pm  slices  using  a 
microtome  and  transferred  onto  a  glass  coverslip.  (C)  These  slices  are  then  imaged  by  autoradiography  or 
radioluminescence  microscopy  (RLM),  which  gives  a  high  resolution  image  of  the  FDG  distribution.  Slices 
are  then  H&E  stained  for  histology. 
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This  protocol  was  first  developed  with  human  clear  cell  renal  carcinoma  samples  due  to  the  abundance  of 
these  samples. 


Objective  2:  Comparative  measurements  of  FDG  uptake  into  prostate  TSCs  of  Gleason 
Grade  3  and  4/5  in  vitro. 


A 
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Task  7: 

We  have  determined  that  the 
development  of  an  image 
correlation  algorithm  to  overlap 
radioluminescence 
measurements  and 

immunohistochemistry  (task  7) 
results  is  not  necessary.  It  is  in 
fact  possible  to  stain  the  exact 
TSC  slice  we  image  in  RLM 
following  the  experiment.  The 
quality  of  the  H&E  slices  are 
good  enough  to  perform  a  direct 
comparison,  which  removes  the 
need  for  the  correlation 
algorithm.  However,  we  have 
decided  to  replace  the 
correlation  algorithm  with  a 
machine  vision  algorithm  that 
can  automatically  detect 
suspicious  features  in  a  sample. 

We  will  implement  this 
algorithm  in  our  analysis  of  task 
9. 

Task  8: 

Following  the  optimization  of  the 
protocol  (task  8  a  &  b),  we  imaged 
human  prostate  TSCs,  which  are 
shown  in  Fig.  5.  Fig  5  A  shows  the 
H&E  stain  of  an  entire  prostate 
TSCs  following  the  procedure. 

These  samples  are  used  to 
determine  the  Gleason  Score.  Fig. 

5  B  shows  the  autoradiography  of 
an  adjacent  TSCs  slice,  where  darker  regions  show  higher  uptake  of  radiotracer  (FDG).  We  also  used 
Cherenkov  imaging  to  gauge  the  localization  of  the  tumor  and  the  ROI  for  RLM  microscopy.  The  results  of 
the  RLM  imaging  of  the  FDG  distribution  in  the  sample  slices  is  given  in  Fig  5  D  (Task  8  c).  This  demonstrates 
that  we  can  continuously  image  the  FDG  in  prostate  TSCs.  The  structure  of  the  signal  easily  shows  the 


Fig.  5:  (A)  H&E  stain  of  10  pm  prostate  TSC  with  the  field  of  view 
of  the  20x  and  40x  RLM  image.  (B)  Autoradiography  image  of  the 
adjacent  prostate  TSC  with  features  that  are  more  FDG  avid  and 
correlate  with  cancer  in  the  H&E  sample.  (C)  Cherenkov  imaging 
of  the  initial  prostate  TSC  (200  pm)  reveals  a  hot  spot.  (D)  RLM 
image  of  10  pm  prostate  TSC  at  20x  and  40x  magnification. 
Features  can  be  resolved  with  a  resolution  of  80  pm.  (E) 
Correlation  of  prostate  cancer  in  the  TSC  with  the  FDG  signal  from 
RLM.  Cancerous  regions  are  outlined  in  the  H&E  image. 
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improved  resolution  and  thus  information  contained  in  these  images,  when  compared  to  the  standard 
method  of  autoradiography.  Fig.  5  E  shows  the  co-localization  of  the  H&E  stain  and  the  FDG  distribution 
in  a  particular  region  of  interest  within  the  slice  (Task  8  d).  The  method  allows  for  subsequent  imaging 
fixing  and  H&E  staining.  RLM  allows  imaging  of  the  FDG  distribution  with  high  resolution  and  reveals 
structures  with  high  FDG  uptake  that  have  a  size  of  80  pm,  which  greatly  surpasses  the  resolution  of 
autoradiography. 

Task  9: 

We  have  begun  in-vitro  imaging  of  FDG 
uptake  in  prostate  cancer  TSCs  and 
subsequent  determination  of  the  local 
Gleason  grades  by  immunohistochemistry. 

The  results  are  shown  in  figure  4. 

Comparing  the  FDG  signal  from  suspicious 
regions  to  the  FDG  signal  from  benign  tissue 
shows  a  statistically  significant  difference  of 
13%  (p=4xl07)  when  using  the  mean 
uptake  and  a  difference  of  21%  (p=0.01) 
when  using  the  max  pixel  uptake.  By 
thresholding  the  FDG  signal  we  can  classify 
the  high  FDG  regions  into  suspicious  tissue. 

Comparison  with  H&E  information,  allows 
us  then  to  calculate  a  sensitivity  of  0.4  and  a 
specificity  of  0.8  for  our  method.  This 
indicates  that  FDG  does  not  accumulate  in  all  cancerous  regions,  but  does  not  give  many  false 
positives. 

Objective  3:  Proof-of-concept  measurements  of  the  cell  metabolism  in  live  TSCs  during 
radiation  treatment. 

Task  12: 

We  determined  that  the  original  objective  3  aims  were  unfeasible  due  to  a  too  short  shelf  life  of  the 
TSCs  in  the  bioreactors  post  radiation  exposure  to  detect  reliable  information.  Instead,  we  expanded 
our  work  on  a  mobile  version  of  the  imaging  technology  of  objective  1  and  2  and  developed  ab 
endoscopic  version  of  the  RLM  microscope  (Figure  5). 


Cancer  Tissue  Cancer  Tissue 


Figure  4:  (A)  Measured  normalized  mean  FDG  signal 
from  RLM  of  areas  determined  to  be  cancer  compared 
to  areas  designated  as  healthy.  (B)  Measured 
normalized  max  FDG  signal  of  the  same  regions.  (C)  four 
sample  cancer  (left)  and  four  tissue  (right)  regions  of 
interests  that  were  used  to  determine  the  values  in 
A&B. 
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Complete  removal  of  residual  tumor  tissue 
during  surgical  resection  improves  patient 
outcomes.  However,  it  is  often  difficult  for 
surgeons  to  delineate  the  tumor  beyond 
its  visible  boundary.  This  has  led  to  the 
development  of  intraoperative  detectors 
that  can  image  radiotracers  accumulated 
within  tumors,  thus  facilitating  the 
removal  of  residual  tumor  tissue  during 
surgical  procedures.  We  introduce  a  beta 
imaging  system  that  converts  the  beta 
radiation  from  the  radiotracer  into 
photons  close  to  the  decay  origin  through 
a  CdW04  scintillator  and  does  not  use  any 
optical  elements.  The  signal  is  relayed  onto 
an  EMCCD  chip  through  a  wound  imaging 
fiber.  The  sensitivity  of  the  device  allows 
imaging  of  activity  down  to  lOOnCi  and  the  system  has  a  resolution  of  at  least  500pm  with  a  field  of 
view  of  4. 80x6. 51mm.  Advances  in  handheld  beta  cameras  have  focused  on  hardware  improvements, 
but  we  apply  machine  vision  to  the  recorded  images  to  extract  more  information.  We  automatically 
classify  sample  regions  in  human  renal  cancer  tissue  ex-vivo  into  tumor  or  benign  tissue  based  on 
image  features.  Machine  vision  boosts  the  ability  of  our  system  to  distinguish  tumor  from  healthy 
tissue  by  a  factor  of  9±3  and  can  be  applied  to  other  beta  imaging  probes. 


Figure  5:  (LEFT)  Radioluminescence  microscopy  (RLM) 
(RIGHT)  On  the  other  hand,  lensless  radioluminescence 
imaging  (LRI)  allows  imaging  of  tissue  that  is  in  contact 
with  the  scintillator  with  a  much  greater  field  of  view 
but  significantly  lower  resolution  because  of  the  lack  of 
an  objective  lens.  The  distribution  of  photons  from  the 
radiotracer  is  directly  mapped  onto  the  imaging  chip. 
The  compact  setup  allows  for  the  addition  of  a  fiber 
bundle  endoscope  between  the  sample  and  scintillator 


Using  the  image  features  from  the  classification  algorithm  that  we  developed,  we  can  now  use 
machine  vision  to  automatically  classify  the  smaller  ROIs  that  are  outlined  in  Fig.  6c  for  the  sample 
arrangement  shown  in  6d.  The  automated  classification  is  shown  in  Fig.  6e,  where  a  red  outline 
indicates  group  1  and  a  blue  outline  indicates  group  2.  We  know  that  the  cancerous  tissue  was  placed 
on  the  right,  so  we  can  rename  the  red  group  1  as  cancer  and  the  blue  group  2  as  normal  tissue.  This 
automated  classification  is  based  on  the  clustering  of  image  features  that  is  shown  in  Fig.  6g.  The  Z- 
score  values  used  for  clustering  of  the  individual  ROIs  in  Fig.  6g  are  shown  in  Supporting  Fig.  SI.  This 
approach  misclassified  17  out  of  78  normal  regions  as  cancer  (false  positives)  and  17  out  of  78  cancer 
regions  as  normal  (false  negatives).  This  translates  into  a  false  positive  rate  of  22%  and  a  false 
negative  rate  of  22%  for  the  shown  sample.  In  all  five  imaged  samples  the  false  positive  rate  was  21± 
3%  and  the  false  negative  rate  was  23±  2%  (Table  S2).  The  misclassified  false  positive  ROIs  of  are  likely 
due  to  the  relatively  high  local  signal  variation,  which  arises  due  to  the  accumulated  FDG  at  the  edge 
of  the  tissue.  The  clustergram  also  indicates  that  prior  knowledge  of  where  cancer  and  normal  tissue 
is  are  not  required.  This  work  was  published  as  a  journal  article  and  is  attached. 
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Texture  matrices  and  image  features 
Pixel  histogram 

-intensity^  &  intensity^  &  intensity^ 
-intensity  standard  deviation 
-skewness  SUV 
-intensity  kurtosis 
Cooccurrence  matrix  (Ml) 

•angular  second  moment 

-correlation 

-contrast 


M2 


Gray  level  run  length  matrix  (M2) 

-short  &  long  run  emphasis 
-gray-level  nonuniformity 
-run  length  nonuniformity 
-run  percentage 

-low  &  high  grey-level  run  emphasis 
-short  run  low  &  high  grey-level  emphasis 
-long  run  low  &  high  grey-level  emphasis 

Neighborhood  gray-tone  difference  matrix  (M3) 

-contrast 


Decision  making 


■  Cancer  tissue 

Figure  6:  Machine  vision  for  the  classification  of  tumor  and  benign  tissue.  (A)  22  image  features  are  used 
for  classification.  All  features  are  calculated  from  the  global  image  (pixel  histogram)  or  one  of  three  types 
of  image  matrices  (Ml-3)  that  capture  local  and  regional  features.  (B)  Image  matrices  and  22  associated 
features  used  for  classification.  (C,D)  LRI  endoscope  with  a  tissue  slice  culture  of  normal  kidney  (left)  and 
renal  cancer  (right).  Selected  ROIs  on  both  samples  are  shown  in  yellow.  Small  ROIs  are  20  by  20  pixels.  (E) 
Computed  and  clustered  image  features  for  all  ROIs  show  the  image  features  that  are  larger  in  the  tumor 
in  red  (Mean  C)  and  larger  in  normal  tissue  (Mean  N).  (F)  Automated  classification  of  small  ROIs  using 
clustering  of  image  features  knowing  which  parameter  are  larger  in  the  tumor  or  normal  tissue  from  (C). 
(G)  Clustering  result  of  the  small  ROIs  with  normal  (blue)  or  tumor  (red).  Seventeen  out  of  78  ROIs  are 
misclassified  in  the  normal  and  in  the  cancer  tissue. 
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Reportable  Outcomes 

Objective  1:  Design  of  a  radioluminescence  microscope  for  the  imaging  of  FDG  uptake  in 
Prostate  tissue  slice  cultures  (TSCs). 

Research 

We  successfully  completed  tasks  1-4  of  objective  1.  This  includes  the  set-up  of  an  inverted 
fluorescence  microscopy  platform  to  image  the  FDG  distribution  in  TSCs  (task  1).  We  also  developed 
an  algorithm  (task  2)  that  can  automatically  detect  decays  and  reconstruct  the  image  to  give  the 
distribution  of  radiotracer  in  the  sample.  The  microscope  was  calibrated  (task  3)  and  we  can 
determine  the  local  number  of  radiotracer  molecules.  The  images  in  figure  3  D  show  resulting  images 
from  FDG  in  a  prostate  TSCs  in  the  microscope  (task  4). 

Training  &  Mentoring: 

The  PI  received  training  in  handling  of  radioisotopes  and  am  approved  to  work  with  isotopes  the 
Stanford  University  School  of  Medicine  (Task  5).  The  PI  has  completed  the  course  work  on  Molecular 
Imaging  in  Living  Subjects  (RAD  222),  attended  and  presented  at  the  Molecular  Imaging  Program  at 
Stanford  (MIPS)  weekly  Seminar  series,  attended  many  Radiological  Sciences  Laboratory  (RSL) 
meetings  and  presented  the  RLM  microscopy  technology  at  the  Annual  Biophysical  society  meeting 
(task  6). 

Objective  2:  Comparative  measurements  of  FDG  uptake  into  prostate  TSCs  of  Gleason 
Grade  3  and  4/5  in  vitro. 

Research: 

We  have  begun  in-vitro  imaging  of  FDG  uptake  in  prostate  cancerTSCs  and  subsequent  determination 
of  the  local  Gleason  grades  by  immunohistochemistry  (task  8)  and  presented  initial  results  in  Fig.  4. 
We  have  replaced  task  7  with  a  more  complex  feature  detection  algorithm,  which  has  led  to  a  project 
on  the  endoscopic  detection  of  renal  cancer. 

These  results  were  presented  at  the  annual  World  Molecular  Imaging  Congress  in  September  2015. 
The  results  were  not  published  in  a  journal  article  because  we  will  aggregate  the  results  of  objective 
1  and  2  to  publish  a  more  thorough  article. 

Training  &  Mentoring: 

The  PI,  Silvan  Tuerkcan,  is  participating  in  the  weekly  Peehl  laboratory  meetings  in  the  Department 
of  Urology  and  has  been  exposed  to  a  large  overview  of  prostate  cancer  topics.  The  PI  has  also 
attended  the  Cancer  Biology  course  (CBIO  101).  The  PI  has  not  attended  the  DoD  IMPaCT  meeting  & 
Society  of  Nuclear  Medicine  Annual  Meeting,  but  he  has  presented  the  work  at  the  World  Molecular 
Imaging  Congress  in  September  2015. 
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The  research  of  aim  2  has  trained  the  PI  in  Hands-on  training  in  prostate  cancer  TSCs  culturing  in 
bioreactors  during  the  experiments  for  the  optimization  of  the  imaging  parameters.  The  PI  was  also 
trained  in  the  determination  of  the  Gleason  score  by  a  pathologist. 

Objective  3:  Proof-of-concept  measurements  of  the  cell  metabolism  in  live  TSCs  during 
radiation  treatment. 

Research: 

We  have  begun  in-vitro  imaging  of  FDG  uptake  in  prostate  cancerTSCs  and  subsequent  determination 
of  the  local  Gleason  grades  by  immunohistochemistry  (task  8).  However,  we  determined  that  the 
original  measurement  of  metabolic  signature  in  TSCs  before  and  after  radiation  treatment  in  the 
same  TSCs  (objective  3)  was  not  feasible.  Instead  we  expanded  our  work  on  the  imaging  technology 
and  developed  an  endoscopic  version  of  the  microscope  and  showed  proof-of-concept  detection  of 
cancer  in  renal  tissue.  We  published  the  attached  research  article  on  this  technology. 

Training  &  Mentoring: 

The  PI,  Silvan  Tuerkcan,  has  attended  the  relevant  classes  and  Urology  Grand  Rounds,  but  not 
attended  the  Society  of  Nuclear  Medicine  Annual  Meeting.  Instead  work  was  presented  at  the 
Molecular  Imaging  Congress. 


Conclusion 

In  summary,  the  current  method  is  able  to  measure  the  uptake  of  FDG  into  TSCs  from  patients,  which 
present  a  faithful  tissue  culture  model  of  prostate  cancer.  The  method  shows  features  of  down  to  80 
pm,  and  shows  a  significant  higher  FDG  uptake  in  cancerous  regions.  Such  a  set-up  can  be  used  to 
further  explore  the  biology  of  prostate  cancer  as  well  as  serve  as  a  base  for  testing  the  efficacy  of 
new  radiotracers  for  prostate  cancer  in  vitro  on  patient  samples. 

We  have  completed  objective  1  and  2.  We  have  removed  task  7  in  objective  2,  because  a  change  in 
the  design  of  the  experiment  delivers  better  imaging  than  expected,  which  removed  the  requirement 
for  the  image  correlation  algorithm.  We  have  instead  developed  a  decision  making  algorithm  based 
on  machine  vision  that  can  automatically  classify  cancer  and  normal  tissue.  We  replaced  objective  3 
by  an  endoscopic  version  of  the  technology  to  show  proof-of-concept  imaging  in  renal  cancer  as  seen 
in  the  published  manuscript. 
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Endoscopic  detection  of  cancer 
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Complete  removal  of  residual  tumor  tissue  during  surgical  resection  improves  patient  outcomes. 
However,  it  is  often  difficult  for  surgeons  to  delineate  the  tumor  beyond  its  visible  boundary.  This  has 
led  to  the  development  of  intraoperative  detectors  that  can  image  radiotracers  accumulated  within 
tumors,  thus  facilitating  the  removal  of  residual  tumor  tissue  during  surgical  procedures.  We  introduce 
a  beta  imaging  system  that  converts  the  beta  radiation  from  the  radiotracer  into  photons  close  to  the 
decay  origin  through  a  CdW04  scintillator  and  does  not  use  any  optical  elements.  The  signal  is  relayed 
onto  an  EMCCD  chip  through  a  wound  imaging  fiber.  The  sensitivity  of  the  device  allows  imaging 
of  activity  down  to  100  nCi  and  the  system  has  a  resolution  of  at  least  500  /zm  with  a  field  of  view 
of  4.80  x  6.51mm.  Advances  in  handheld  beta  cameras  have  focused  on  hardware  improvements, 
but  we  apply  machine  vision  to  the  recorded  images  to  extract  more  information.  We  automatically 
classify  sample  regions  in  human  renal  cancer  tissue  ex-vivo  into  tumor  or  benign  tissue  based  on  image 
features.  Machine  vision  boosts  the  ability  of  our  system  to  distinguish  tumor  from  healthy  tissue  by  a 
factor  of  9  dz  3  and  can  be  applied  to  other  beta  imaging  probes. 


It  is  well  documented  that  better  removal  of  residual  tumor  during  surgery  improves  the  outcome  for  patients1-4. 
However,  it  is  often  difficult  to  delineate  the  tumor  beyond  its  visible  boundary.  A  few  technologies  that  improve 
the  resection  of  tumors  include  microscopy,  stereotactic  navigation,  intraoperative  low-field  MRI,  matrix- assisted 
laser  desorption  ionization  for  mass  spectrometry  imaging  (MALDI),  and  ultrasound  imaging5-8.  Progress  has 
also  been  made  with  tracer  molecules  and  particles  that  specifically  target  the  tumor  and  can  be  interrogated  opti¬ 
cally,  via  ultra-  sound,  or  by  emitted  radiation.  Radiotracers,  in  particular,  have  experienced  tremendous  growth 
and  adoption  in  the  clinic,  driven  mainly  by  new  radioimaging  modalities  such  as  positron  emission  tomography 
(PET)  imaging9.  This  has  lead  to  the  development  of  dedicated  intraoperative  tools  to  detect  radiotracers. 

Intraoperative  detectors  and  cameras  that  can  image  radiotracers  specifically  targeted  or  preferentially  accu¬ 
mulated  in  tumors  can  facilitate  the  removal  of  residual  tumor  during  surgical  procedures.  Radiotracers  have 
already  been  employed  for  surgical  guidance  during  the  resection  of  breast  tumors,  thyroid  tumors,  squamous 
cell  carcinoma,  melanoma,  and  gliomas.  Consequently,  there  is  an  interest  in  the  development  of  devices  that  can 
image  radiotracers  in  an  intraoperative  setting.  Early  imaging  devices  have  focused  on  the  detection  of  gamma 
radiation  and  have  found  use  both  in  clinical  trials  and  the  clinic10-15.  The  disadvantage  of  imaging  gamma  radia¬ 
tion  is  that  gamma  rays  travel  many  centimeters  through  tissue  before  they  can  be  detected,  leading  to  decreased 
resolution  and  a  high  level  of  background  signal  from  distant  tissue  that  may  have  high  tracer  uptake.  For  this 
reason,  and  further  driven  by  the  clinical  development  of  beta  emitting  radioisotopes,  beta  particle  detectors  are 
becoming  a  focus  of  research  and  development  for  imaging  in  the  clinical  setting. 

The  development  of  beta  detectors  can  be  categorized  into  pure  detectors,  which  yield  a  reading  at  a  certain 
spot16-21,  and  imaging  devices,  which  give  an  actual  picture  of  the  radiotracer  distribution22-28.  The  principal  need 
for  the  actual  imaging  of  the  radiotracer  distribution  in  a  sample  is  not  for  the  primary  detection  of  tumors  or 
positive  lymph  nodes  but  for  the  detection  of  residual  cancer  in  the  surgical  cavity  Scanning  a  beta  detector  across 
the  cavity  to  map  the  radiation  would  require  a  long  time  and  a  steady  hand,  while  imaging  systems  can  provide  a 
picture  of  the  distribution  with  a  high  resolution  down  to  500  /zm29.  The  major  challenges  in  the  development  of 
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such  devices  are  decreasing  acquisition  times,  increasing  sensitivity,  and,  most  importantly,  improving  the  ability 
to  distinguish  tumor  from  healthy  tissue.  Until  now,  such  improvements  were  driven  by  a  focus  on  developing 
better  hardware. 

We  introduce  an  extremely  simple  objective-lens-free  beta  imaging  system  termed  lens-less  radiolumines¬ 
cence  imaging  (LRI)  that  uses  a  scintillator  to  convert  the  beta  radiation  emitted  from  radiotracers  in  biological 
tissue  into  photons  near  the  decay  origin.  We  evaluate  the  sensitivity  and  resolution  of  the  system  and  compare 
it  to  other  beta  imaging  systems.  The  principal  advantage  of  our  system  is  its  imaging  capability  with  a  relatively 
large  number  of  pixels  and  field-of-view,  allowing  for  the  application  of  machine  vision  techniques  that  can  ana¬ 
lyze  the  recorded  images  and  extract  greater  amounts  of  clinically  actionable  information.  We  demonstrate  this 
by  automatically  classifying  regions  of  human  renal  cancer  tissue  samples  as  cancerous  or  benign  based  on  image 
features  ex-vivo.  Machine  vision  boosts  the  ability  of  our  system  to  distinguish  tumor  from  healthy  tissue  by  a  fac¬ 
tor  of  9  and  provides  a  simple  means  by  which  to  improve  the  detection  sensitivity  of  other  beta  imaging  probes. 

Results 

Experimental  setup  of  Lensless  radioluminescence  imaging.  The  details  of  the  optical  set-up  are 
highlighted  in  Fig.  1.  Radioluminescence  microscopy  (RLM)  (Fig.  la)  was  originally  developed  to  achieve  radio- 
tracer  detection  at  single-cell  resolution  in  order  to  study  cell-to-cell  variations  in  tracer  uptake30'34.  RLM  utilizes 
a  thin  scintillator  plate,  which  is  in  contact  with  the  cells  of  interest,  to  convert  ionizing  radiation  from  emit¬ 
ted  beta  particles  into  visible-range  photons  detectable  by  a  sensitive  microscope.  High  resolution  is  achieved 
through  the  magnification  of  the  microscope  objective  lens.  However,  as  a  microscopy  technique,  RLM  has  a 
relatively  small  field  of  view  (1  mm2).  When  tissue  slices  are  imaged,  even  RLM  cannot  resolve  individual  cells 
because  cells  are  tightly  packed  together.  Thus  for  tissue  imaging  applications,  it  is  more  desirable  to  lower  the 
resolution  of  the  imaging  technology  in  favor  of  a  larger  field  of  view.  Lens-less  radioluminescence  imaging  (LRI) 
is  a  compact  optical  setup  that  places  a  thin  scintillator  plate  in  contact  with  the  tissue  of  interest  in  order  to  con¬ 
vert  the  locally  emitted  beta  particles  into  visible-range  photons  (Fig.  lb).  The  system  then  directly  maps  these 
photons  onto  a  CCD  chip  without  an  objective  lens.  This  permits  for  the  insertion  of  an  imaging  fiber  bundle 
endoscope,  which  allows  the  imaging  tip  to  be  scanned  over  a  tissue  surface.  The  relaying  lens  in  the  optical  path 
behind  the  fiber  bundle  does  not  create  an  image,  but  instead  maps  the  light  from  the  fibers  onto  the  16  /xm  CCD 
chip.  The  relaying  lens  is  used  because  we  cannot  bond  the  fibers  directly  onto  the  fragile  CCD  chip.  This  simple 
radioluminescence  imaging  setup  yields  a  visible  field  of  view  of  4.80  x  6.51  mm  with  407  x  300  pixels,  which 
forms  a  true  image  of  the  radiotracer  distribution  in  the  tissue  and  allows  for  image  processing.  The  full  size  of  the 
imaging  bundle  is  5  x  6.7  mm,  with  a  fiber  size  of  10  /xi n.  The  development  is  motivated  by  a  host  of  clinical  appli¬ 
cations  using  lensless  microscopy  in  the  visible  spectrum35.  The  advantages  for  these  types  of  imaging  devices  are 
their  compact  architecture  and  large  field  of  view.  In  this  work  we  focus  on  imaging  the  beta  radiation  from  the 
18F  isotope  in  Fluorodeoxyglucose  (FDG)  because  of  its  clinical  importance  and  routine  use. 

Sensitivity.  The  sensitivity  of  the  lensless  radioluminescence  imaging  device  was  evaluated  in  contact  mode 
with  respect  to  two  factors,  which  are  the  signal-to-noise  ratio  (SNR)  and  detection  limit.  To  evaluate  the  SNR, 
we  placed  a  droplet  of  1  /xCi  FDG  on  a  glass  slide  and  let  the  liquid  evaporate  to  yield  a  300  /xm  spot.  The  spot  was 
then  imaged  with  the  LRI  system  with  and  without  a  background  FDG  sample  of  500  /xCi  directly  behind  the  glass 
slide  to  provide  a  background  of  gamma  radiation.  This  image  series  is  shown  in  Fig.  2a  for  a  range  of  acquisition 
times  (tacq).  The  system  was  able  to  detect  the  dried  1  /xCi  spot  even  at  an  tacq  of  0.5  s  with  a  SNR  of  4.  The  SNR  for 
all  images  is  shown  in  Fig.  2b.  To  evaluate  a  lower  limit  of  detection,  we  used  a  51nCi  204Ti  pocket  point  source  2c. 
The  LRI  system  can  still  detect  the  point  source  using  a  tacq  of  60  s.  The  lower  detection  efficiency  (^17%)  of  the 
point  source  with  respect  to  the  dried  FDG  is  probably  due  to  the  fact  that  the  emitting  isotope  cannot  be  placed 
in  direct  contact  with  the  scintillator  because  of  the  source  geometry 

Resolution.  The  resolution  of  the  LRI  system  was  tested  by  placing  two  drops  of  dried  FDG  (1  /x  Ci)  at  a  dis¬ 
tance  of  500  /xm.  The  contact  mode  images  in  Fig.  3  show  that  both  spots  can  be  clearly  distinguished  giving  an 
upper  estimate  for  the  resolution.  The  full  width  half  maximum  (FWHM)  of  a  Gaussian  fit  to  the  image  of  the 
pocket  source  gives  a  spot  of  300  /xm  for  the  51nCi  204Ti  point  source. 

Automated  classification  of  tissue.  The  strength  of  the  LRI  endoscope  system  is  the  imaging  capability 
with  respect  to  the  large  amount  of  pixel  per  image  and  the  resolution  of  500  /xm.  To  demonstrate  this,  we  imaged 
human  renal  tissue  slice  cultures  (TSCs)  from  patients  undergoing  resection  of  renal  cell  carcinoma  (RCC).  Cores 
of  normal  kidney  and  RCC  were  obtained  and  maintained  as  thin,  precion-cut  TSCs  overnight.  Before  imaging, 
the  tissue  was  starved  of  glucose  and  incubated  with  FDG  ex-vivo  as  shown  in  Fig.  4a, b. 

To  verify  if  FDG  accumulation  occurs  in  ex  vivo  cancer  tissue  during  incubation  with  radiotracer,  we  per¬ 
formed  murine  engraftment  studies  using  bioluminescent  4T1  breast  cancer  cells.  Bioluminescent  4T1  cells 
were  injected  into  the  mammary  fat  pad  of  two  mice  and  tumors  were  allowed  to  develop  until  metastasis  were 
detected  in  the  lung.  Following  excision,  the  lungs  were  incubated  ex-vivo  in  FDG  and  rinsed  in  PBS.  Lung  metas- 
tases  are  highlighted  by  the  yellow  arrows  in  excised  lungs  from  two  animals  (Fig.  5).  The  lung  of  a  control  animal 
without  tumor  is  shown  in  the  top  row  for  comparison.  FDG  was  directly  detected  by  Cherenkov  imaging  in  an 
IVIS  system.  High  intensity  regions  in  the  Cherenkov  image  are  due  to  a  high  local  uptake  in  FDG.  The  control 
lung  without  4T1  metastases  shows  low  levels  of  Cherenkov  light  at  its  edges,  likely  an  artifact  of  FDG  accumula¬ 
tion  due  to  drying.  Notably,  there  was  complete  absence  of  signal  within  the  tissue  edges.  To  confirm  the  presence 
of  4T1  metastases,  bioluminescence  imaging  of  the  lung  sample  was  performed.  Regions  of  cancer  metastases 
identified  by  bioluminescence  correlated  well  with  FDG  uptake  determined  by  Cherenkov  imaging,  validating 
the  ex-vivo  radiotracer  incubation  procedure. 
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Figure  1.  Lensless  radioluminescence  imaging  with  an  endoscope.  (A)  Radioluminescence  microscopy 
(RLM)  allows  for  the  high  resolution  (10  /xm)  imaging  of  beta-radiation  emitting  radiolabeled  molecules  in 
individual  cells30,31.  The  advantage  of  the  technique  is  that  decays  are  converted  to  an  optical  signal  close  to  the 
origin  of  the  decay,  which  enables  decay  detection  with  single- cell  resolution.  RLM  utilizes  a  thin  scintillator 
plate,  which  is  in  contact  with  the  cells  of  interest,  to  convert  ionizing  radiation  from  emitted  beta  particles  into 
visible-range  photons  detectable  in  a  sensitive  microscope.  (B)  On  the  other  hand,  lensless  radioluminescence 
imaging  (LRI)  allows  imaging  of  tissue  that  is  in  contact  with  the  scintillator  with  a  much  greater  field  of  view 
but  significantly  lower  resolution  because  of  the  lack  of  an  objective  lens.  The  distribution  of  photons  from 
the  radiotracer  is  directly  mapped  onto  the  imaging  chip.  The  compact  setup  allows  for  the  addition  of  a  fiber 
bundle  endoscope  between  the  sample  and  scintillator  and  the  detection  camera. 


Next,  we  assessed  the  performance  of  LRI  to  image  tumor  burden  in  clinical  tissue  samples.  Samples  of  renal 
tissue  from  patients  undergoing  nephrectomy  were  prepared  as  thin  tissue  slice  cultures  (TSCs)  and  exposed  to 
FDG  (Fig.  4a).  Following  incubation,  samples  of  both  healthy  and  tumor  burdened  renal  tissue  were  positioned 
side  by  side  on  the  endoscope  and  prepared  for  LRI  (Fig.  4c, d).  LRI  revealed  a  clear  signal  in  the  renal  cancer 
sample  resolved  with  acquisition  times  of  60  and  30  s  (Fig.  4d,e).  A  standard  intensity  value  measurement  (lmax) 
shows  values  of  940  for  the  normal  tissue  and  1205  for  the  cancer  tissue.  Similarly,  the  mean  uptake  value  (Imean) 
is  300  ±  20  for  the  normal  tissue  and  490  ±  20  for  the  cancer  tissue.  Although  the  cancer  displays  quantitatively 
higher  lmax  and  Imean  values,  the  difference  remains  small  and  may  not  be  distinguishable  in  a  patient. 

This  ambiguity  in  decision  making  between  cancerous  and  normal  tissue  motivated  the  application  of 
machine  vision  to  images  generated  with  LRI.  The  use  of  machine  vision  in  LRI  is  possible  because  of  the  large 
number  of  pixels  and  resolution  limits  afforded  to  this  approach.  Textural  analysis  of  image  features  was  achieved 
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Figure  2.  Sensitivity  measurements  of  the  LRI  endoscope.  (A)  Series  of  signal-to-noise  ratio  (SNR) 
measurements  using  a  dried  drop  of  FDG  (1  /xCi)  at  different  acquisition  times  ( tacq )  without  (left)  and  with 
(right)  background  from  gamma  radiation.  (B)  Summary  of  SNR  with  respect  to  acquisition  time.  (C)  Lower 
limit  of  detection  measured  with  a  100  nCi  pocket  source. 


by  following  the  the  work  of  Tixier  et  al.36  in  2  dimensions  through  the  resampling  of  pixels  in  a  region  of  interest 
(ROI),  followed  by  computing  three  different  texture  matrices  (Ml-3)  or  by  analyzing  all  pixels  in  the  ROI.  The 
three  texture  matrices  capture  local  and  regional  textures  by  describing  how  a  single  pixel  or  a  group  of  pixels 
differ  with  respect  to  their  surroundings.  The  pixel  statistics  of  the  entire  ROI  captures  global  texture.  The  cooc¬ 
currence  matrix  (Ml)  is  a  local  measurement  that  characterizes  texture  by  means  of  second  order  statistics  and, 
captures  how  the  pixels  immediately  surrounding  a  pixel  differ  (Fig.  6a)37,38.  We  calculate  three  features  from  this 
matrix,  which  are  listed  in  Fig.  6b.  The  gray  level  run  length  matrix  (M2)  describes  the  occurrence  of  runs  for  each 
gray  level  and  length  in  different  directions39-41.  The  1 1  features  calculated  from  this  matrix  are  listed  in  Fig.  6b. 
Finally,  the  neighborhood  gray-tone  difference  matrix  (M3)  is  a  local  measure  of  texture  that  captures  how  groups 
of  pixels  of  a  certain  gray  scale  immediately  surrounding  a  pixel  differ,  providing  an  additional  feature36,41.  This 
matrix  gives  us  an  additional  feature.  Together,  these  21  image  features  allow  us  to  classify  regions  of  interest. 

First,  we  start  by  defining  6x13  ROIs  that  cover  most  of  the  tissues  of  interest,  one  in  the  cancer  sample  and 
one  in  the  normal  tissue  sample  of  the  image  (Fig.  6c).  Automated  clustering  based  on  these  features  measured 
over  the  entire  group  of  ROIs  highlights  how  cancer  tissue  differs  from  normal  tissue  in  terms  of  these  features. 
As  previously  observed  with  the  normal  intensity  analysis,  the  cancer  tissue  shows  a  higher  intensity  (I)  ( lmean  & 
lmin  &  lmax).  However,  machine  vision  now  offers  an  additional  18  features  that  highlight  the  difference  between 
cancer  and  normal  tissue  (Fig.  6e).  Notably  cancer  tissue  shows  greater  contrast  and  gray  level  run  emphasis, 
while  normal  tissue  is  more  uniform. 

Using  the  image  features,  we  can  now  use  machine  vision  to  automatically  classify  the  smaller  ROIs  that  are 
outlined  in  Fig.  6c  for  the  sample  arrangement  shown  in  6d.  The  automated  classification  is  shown  in  Fig.  6e,  where 
a  red  outline  indicates  group  1  and  a  blue  outline  indicates  group  2.  We  know  that  the  cancerous  tissue  was  placed 
on  the  right,  so  we  can  rename  the  red  group  1  as  cancer  and  the  blue  group  2  as  normal  tissue.  This  automated 
classification  is  based  on  the  clustering  of  image  features  that  is  shown  in  Fig.  6g.  The  Z-score  values  used  for  clus¬ 
tering  of  the  individual  ROIs  in  Fig.  6g  are  shown  in  Supporting  Fig.  SI.  This  approach  misclassified  17  out  of  78 
normal  regions  as  cancer  (false  positives)  and  17  out  of  78  cancer  regions  as  normal  (false  negatives).  This  trans¬ 
lates  into  a  false  positive  rate  of  22%  and  a  false  negative  rate  of  22%  for  the  shown  sample.  In  all  five  imaged  sam¬ 
ples  the  false  positive  rate  was  21  ±  3%  and  the  false  negative  rate  was  23  ±  2%  (Table  S2).  The  misclassified  false 
positive  ROIs  of  are  likely  due  to  the  relatively  high  local  signal  variation,  which  arises  due  to  the  accumulated  FDG 
at  the  edge  of  the  tissue.  The  clustergram  also  indicates  that  prior  knowledge  of  where  cancer  and  normal  tissue  is 
are  not  required.  Clustering  the  image  features  will  automatically  yield  groups  and  show  which  ROIs  are  similar. 
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Figure  3.  Resolution  of  the  LRI  endoscope.  Series  of  images  from  two  dried  drops  of  FDG  (1  fid),  which  are 
separated  by  500  fim  at  different  acquisition  times  {tacq).  The  line  scan  along  the  row  of  the  maximum  pixel  is 
shown  for  the  different  tacq  using  the  color  code  in  the  image  frames.  Both  spots  can  be  resolved  down  to  an  f 
of  1  s. 


Discussion 

The  development  of  intraoperative  beta  probes  is  driven  by  the  premise  of  achieving  better  patient  outcomes 
following  surgical  resection  of  tumors  by  more  accurately  distinguishing  residual  tumor  presence.  This  tech¬ 
nology  is  especially  important  for  the  treatment  of  cancers  such  as  glioma,  where  precisely  determining  tumor 
margins  has  been  shown  to  improve  prognosis  following  surgery  and  handheld  beta  probes  in  conjunction  with 
new  probes  allow  definition  of  the  lesion  boundary  beyond  the  visible  tumor  boundary19,42-44.  Beta  probes  can 
be  divided  in  detectors  and  probes  that  have  imaging  capabilities.  The  advantage  of  the  imaging  capabilities  of 
the  probe  is  a  better  resolution  and  it  is  crucial  for  the  detection  of  small  tumors  where  scanning  probes  becomes 
time  consuming. 

We  have  developed  a  relatively  simple  beta  particle  imaging  technique  called  LRI,  based  on  a  CdW04  scin¬ 
tillator  crystal,  which  is  directly  coupled  to  a  wound  imaging  fiber  bundle  with  10  /j,m  fibers  in  a  5  by  6.7  mm 
bundle.  The  handheld  fiber  bundle  allows  the  system  to  be  flexible  and  mobile,  enabling  intraoperative  imaging 
of  tissue  by  simply  scanning  its  surface  and  mapping  the  signal  onto  a  EMCCD  chip.  LRI  can  detect  a  source  with 
an  activity  down  to  100  nCi  or  3700  Bq  with  an  acquisition  time  of  60  s.  Higher  activity  allows  the  imaging  with 
acquisition  times  down  to  5  s.  Other  beta  cameras  with  imaging  capabilities  allow  imaging  of  lOOnCi24,  2nCi29, 
and  5000  nCi28  with  acquisition  times  ranging  from  2  to  30  s.  Our  sensitivity  is  thus  comparable  to  other  imaging 
beta  cameras,  whose  slightly  better  performance  is  achieved  by  detecting  beta  and  gamma  emissions  from  the 
sample.  Cameras  such  as  these  require  subtracting  the  background  gamma  emission  in  order  to  improve  image 
quality  The  background  gamma  emission  did  not  pose  a  problem  to  our  relatively  simple  imaging  system,  as 
shown  in  Fig.  2,  where  the  SNR  of  our  system  was  not  impacted  by  the  background  gamma  radiation  from  an 
activity  of  500  nCi.  Overall,  the  LRI  systems  SNR  is  comparable  with  other  handheld  beta  cameras  that  use  more 
sophisticated  engineering  to  improve  light  guiding  to  improve  detection  efficiency  or  background  subtraction28,29. 

The  resolution  of  the  LRI  system  presented  here  is  at  least  500  /xm  with  a  field  of  view  of  4.80  x  6.51  mm,  which 
we  determined  by  clearly  resolving  two  dried  FDG  spots  of  1  /iCi.  A  handheld  device  with  a  CsI:Ti  scintillator 
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Figure  4.  LRI  imaging  of  human  tissue  slice  cultures  (TSCs)  of  renal  cell  carcinoma  and  benign  kidney 
tissue.  (A)  Surgical  removal  of  cancer  tissue  and  preparation  of  kidney  TSCs.  (B)  Experimental  method 
for  imaging  FDG  uptake  in  human  renal  TSCs.  (C)  LRI  endoscope  with  a  TSCs  of  benign  kidney  (left)  and 
RCC  (right).  (D,E)  Images  of  the  distribution  of  FDG  in  the  TSCs  with  an  acquisition  time  of  60s  and  30  s, 
respectively.  (F)  H&E  stain  of  normal  kidney  sample.  (G)  H&E  stain  of  tumor  samples  shows  clear  cell  renal 
carcinoma. 


coupled  to  a  compact  silicon  photomultiplier  achieves  1.5  mm24  with  a  field  of  view  of  10  x  10  mm2.  Previous 
iterations  of  scintillators  coupled  to  a  photomultiplier  have  shown  a  resolution  of  500-600  fi m  with  a  field  of 

1.2  cm2  22’25-29. 

The  purpose  of  handheld  beta  cameras  is  to  assist  surgeons  in  identifying  residual  tumor  during  surgery 
and  guide  resection.  A  measure  of  the  ability  to  distinguish  tumor  from  normal  tissue  is  to  measure  the  tumor 
to  normal  ratio  (TNR)  in  terms  of  measured  signal  strength.  Non-imaging  beta  cameras  that  only  detect  beta 
radiation  and  have  poor  resolution,  can  achieve  TNRs  of  3.519,  3-1020,  1.24-3.421,  2.7-6.345,  and  6.617.  Tipnis 
et  al.  demonstrated  a  TNR  of  10  using  an  imaging  system  probe  that  subtracts  gamma  radiation  from  the  acquired 
signal.  In  their  work,  tumor  phantom  had  an  activity  12  times  that  of  the  background  phantom.  However,  TNRs 
in  cancer  patients  vary  between  1.3  and  16.  Our  TNR  of  the  shown  sample  of  2.1  was  obtained  by  comparing  the 
mean  FDG  uptake  in  a  human  RCC  cancer  TSC  and  comparing  it  to  a  normal  renal  TSC,  which  is  above  a  ratio 
of  1.5.  The  average  TNR  of  all  samples  is  3  =t  1.  A  TNR  of  1.5  is  considered  to  be  required  for  tumor  detection17. 
However,  we  believe  that  this  ratio  is  not  stringent  enough  to  robustly  aid  the  surgeon  in  determining  residual 
cancer.  Therefore,  we  have  added  machine  vision  to  better  process  the  images  taken  by  handheld  beta  cameras. 
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Figure  5.  FDG  uptake  correlates  with  cancer.  Bioluminescent  4T1  cancer  cells  were  grown  in  the  mammary 
fat  pad  of  mice  and  the  cancer  was  allowed  to  grow  until  it  metastasized  into  the  lung.  Lung  metastases  are 
highlighted  by  the  yellow  arrows  in  excised  lungs  from  two  animals.  The  control  animal,  shown  in  the  top  row, 
did  not  have  a  primary  tumor  and  consequently  no  metastases.  Lungs  were  subsequently  incubated  in  FDG 
under  the  same  conditions  as  the  human  TSCs.  FDG  is  directly  imaged  using  Cherenkov  imaging  in  an  IVIS 
system.  High  intensity  regions  in  the  Cherenkov  image  are  due  to  a  high  local  uptake  in  FDG.  The  control  lung 
without  cancer  shows  low  levels  of  Cherenkov  light  at  the  edges,  which  maybe  an  artifact  of  FDG  accumulation 
due  to  drying.  The  bioluminescence  image  of  the  4T1  cells  (cancer  cells)  in  the  lung  shows  the  location  of  the 
metastatic  4T1  cancer  cells.  Regions  of  cancer  metastases  correlate  well  with  the  FDG  uptake  that  is  determined 
by  Cherenkov  imaging.  This  shows  that  ex-vivo  incubation  with  a  radiotracer  is  a  valid  procedure  similar  to  in- 
vivo  radiotracer  uptake. 


Recent  advances  in  handheld  beta  cameras  have  focused  on  hardware  improvements  and  have  produced 
devices  with  imaging  capabilities  that  greatly  increase  spatial  resolution.  However,  increasing  resolution  through 
image  analysis  has  not  yet  been  explored.  Processing  captured  images  using  image  analysis  techniques  can  poten¬ 
tially  add  significantly  more  value  to  captured  images.  Machine  vision  is  an  easily  implemented  process  that 
can  aid  in  the  classification  of  clinical  images,  as  has  been  shown  in  predicting  the  response  to  concomitant 
radiochemotherapy  in  esophageal  cancer  using  PET  imaging36.  We  used  the  global  information  from  all  pixels 
in  the  image  and  three  texture  matrices:  cooccurrence  matrix,  gray  level  run  length  matrix,  and  neighborhood 
gray- tone  difference  matrix.  The  resulting  21  image  features  can  distinguish  well  between  cancer  and  normal 
tissue  for  our  clinical  renal  samples  (6d).  In  general,  cancer  tissue  displays  more  contrast,  correlation,  and  high 
gray  level  run  emphasis  along  with  an  overall  higher  FDG  signal.  Automated  clustering  of  smaller  ROIs  shows 
how  this  endoscope  could  be  operated  in  a  decision  making  process  (6f,g).  ROIs  in  the  cancer  and  normal  tissue 
group  strongly  Seventeen  out  of  78  normal  ROI  are  misclassified  into  cancer  (false  positives),  which  is  most  likely 
caused  by  excess  FDG  runoff  at  the  edge  of  the  tissue.  Using  the  21  features  greatly  increases  the  TNR  because 
we  now  added  much  higher  dimensionality  to  the  data  compared  to  only  using  mean  counts.  The  TNR  could 
now  be  calculated  by  combining  the  TNR  of  all  of  the  16  independent  image  features  out  of  the  total  21  image 
features.  This  improves  the  TNR  of  2.1  of  the  initial  system  to  a  TNR  of  18,  simply  by  extracting  more  information 
from  the  acquired  data  using  machine  vision  (Table  S3).  The  TNR  from  the  independent  image  features  of  all 
samples  amounts  to  26  ±  19  and  translates  into  a  9  ±  3  fold  improvement  in  TNR  by  using  image  features  (Table 
S4).  This  approach  for  improving  the  TNR  is  easy  to  implement  and  can  be  applied  to  other  beta  imaging  probes. 
Adopting  a  machine  vision  procedure  can  further  improve  clinically  important  improvements  by  switching  from 
the  1.5-1  ratiometric  threshold  criteria  for  distinguishing  disease  from  normal  tissue  to  the  three-sigma  statis¬ 
tical  threshold  criteria  for  this  new  class  of  imaging  based  beta  probes46.  The  current  classification  of  cancer  and 
normal  tissue  and  the  TNR  can  be  improved  by  realizing  that  the  applied  clustering  based  on  Z-values  assumes  a 
Gaussian  distribution,  which  is  a  good  first  estimate,  but  certainly  an  oversimplification.  Certain  image  features 
have  non- Gaussian  distributions  and  may  not  take  on  negative  values.  The  use  of  a  folded  Gaussian  or  other 
models  for  describing  the  distribution  of  image  features  in  the  ROIs  will  improve  the  clustering  efficiency  and  can 
reduce  the  rate  of  false  positives  and  false  negatives  and  are  an  avenue  for  improving  the  technology 

Methods 

Lensless  radioluminesence  imaging  (LRI).  LRI  utilizes  a  10  x  10  x  0.5mm  CdW04  scintillator  crystal 
(MTI  Corporation),  which  is  in  contact  with  the  tissue  of  interest,  to  convert  ionizing  radiation  from  emitted 
beta  particles  of  tracers  in  the  tissue  into  visible-range  photons  detectable  in  a  sensitive  microscope.  The  collected 
photons  pass  through  a  wound  fiber  bundle  (IG- 567,  Schott  AG)  and  are  mapped  onto  a  camera  chip  via  a  relaying 
lens  (Schott  AG).  The  wound  fiber  bundle  allows  motion  of  the  imaging  tip  while  the  camera  stays  in  place.  The 
fiber  bundle  has  a  40%  transmission  between  500  and  1200  nm,  a  numerical  aperture  of  0.63,  and  length  1.720  m. 
The  5  by  6.7  mm  fiber  bundle  has  10  /im  elements  in  a  6  x  6  array  The  camera  is  a  EMCCD  (Pro EM,  Princeton 
Instruments,  Trenton,  NJ)  with  a  512  x  512  imaging  chip  with  a  pixel  size  of  16  n m.  The  imaging  setup  yields  a  visi¬ 
ble  field  of  view  of  4.80  x  6.51  mm  with  407  x  300  pixels.  Images  were  analyzed  using  Matlab  R2012b  (Mathworks). 

Renal  cancer  tissue  preparation.  Fresh  renal  cell  carcinoma  (RCC)  and  normal  kidney  tissues  were 
obtained  from  patients  undergoing  nephrectomy  at  Stanford  with  informed  consent.  All  human  tissue  studies 
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Decision  making 
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IShort  Low  Gray  Level  Run  Emphasis 


■  Cancer  tissue 


Figure  6.  Machine  vision  for  the  classification  of  tumor  and  benign  tissue.  (A)  22  image  features  are  used  for 
classification.  All  features  are  calculated  from  the  global  image  (pixel  histogram)  or  one  of  three  types  of  image 
matrices  (Ml -3)  that  capture  local  and  regional  features.  (B)  Image  matrices  and  22  associated  features  used  for 
classification.  (C,D)  LRI  endoscope  with  a  tissue  slice  culture  of  normal  kidney  (left)  and  renal  cancer  (right). 
Selected  ROIs  on  both  samples  are  shown  in  yellow.  Small  ROIs  are  20  by  20  pixels.  (E)  Computed  and  clustered 
image  features  for  all  ROIs  show  the  image  features  that  are  larger  in  the  tumor  in  red  (Mean  C)  and  larger  in 
normal  tissue  (Mean  N).  (F)  Automated  classification  of  small  ROIs  using  clustering  of  image  features  knowing 
which  parameter  are  larger  in  the  tumor  or  normal  tissue  from  (C).  (G)  Clustering  result  of  the  small  ROIs  with 
normal  (blue)  or  tumor  (red).  Seventeen  out  of  78  ROIs  are  misclassified  in  the  normal  and  in  the  cancer  tissue. 


were  conducted  in  accordance  with  and  were  approved  by  the  Stanford  University  institutional  review  board  of 
the  Research  Compliance  Office  (RCO).  We  only  used  approved  protocols  in  this  work.  Cores  from  nephrectomy 
specimens  were  prepared  with  an  automated  coring  device  (Alabama  Research  and  Development,  Mundford,  AL) 
under  aseptic  conditions  before  precision-cutting  of  tissue  into  300  /im  thick  tissue  slices  was  performed  with  a 
Krumdieck  tissue  sheer  (Alabama  Research  and  Development)  as  previously  described47-49.  Frozen  sections  were 
utilized  to  histologically  confirm  the  diagnosis  of  RCC  and  benign  histology  The  tissue  slices  were  placed  on  grids 
in  6-well  dishes  containing  Complete  PFMR-4A  medium  and  incubated  overnight  on  a  rotary  apparatus  in  a  37 
degree  5%  C02  incubator48.  Before  imaging,  the  tissue  was  starved  of  glucose  for  45  minutes  and  incubated  with 
FDG  (100  /iCi/mL)  for  15  minutes  ex-vivo.  TSCs  were  then  rinsed  three  times  in  PBS. 
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Animal  Model.  All  animal  studies  were  conducted  in  accordance  with  and  were  approved  by  the  Stanford 
University  Institutional  Animal  Care  and  Use  Committee  (IACUC)  and  used  approved  protocols.  Female  Nu/nu 
mice  were  purchased  from  Charles  River  Laboratories  (Wilmington,  Massachusetts).  lxlO6  bioluminescent  4T1 
breast  cancer  cells50  were  freshly  harvested  and  resuspended  in  a  100  fiL  solution  containing  50%  culture  medium 
and  50%  Matrigel  (BD  Biosciences).  The  suspension  was  then  orthotopically  implanted  by  injection  into  the  4th 
left  mammary  fat  pad  and  tumors  were  grown  over  3  weeks. 

Cherenkov  and  bioluminescence  imaging  of  lungs.  Cherenkov  and  bioluminescence  imaging  were 
performed  with  an  optical  imaging  system  (Xenogen  IVIS  200)  and  an  acquisition  time  of  60  s.  Following 
Cherenkov  imaging,  we  added  luciferin  to  trigger  bioluminescence,  which  was  imaged  with  an  acquisition  time 
of  5  s. 

Radiotracer  (FDG)  production.  The  glucose  analogue  FDG  was  prepared  from  mannose  triflate  precursor 
via  nucleophilic  18F-fluorination  and  hydrolysis.  The  18F  was  produced  in  a  GE  PETtrace  cyclotron.  The  produc¬ 
tion  was  performed  on  a  cassette  based  automated  synthetic  module  (FASTlab,  GE  Healthcare).  Quality  control 
criteria  were  set  and  the  tests  were  performed  according  to  USP823.  Because  of  its  short  lifetime,  FDG  was  used 
within  8  h  after  it  was  produced  and  dosed  at  the  levels  described  below  for  experiments.  The  radioactivity  was 
measured  with  a  dose  calibrator. 

SNR  calculation.  The  signal  to  noise  ratio  (SNR)  was  calculated  by  dividing  the  amplitude  A  of  the  signal 
by  the  square  root  of  the  square  of  the  standard  deviation  <jbG  of  the  background  intensities  plus  the  amplitude 
A  (shot  noise)  using: 


■yjA  +  crBG  (i) 

The  amplitude  was  determined  by  subtracting  the  image  background  and  applying  a  Gaussian  fit  to  the  signal. 
The  standard  deviation  of  the  background  intensities  was  measured  on  a  ROI  that  did  not  contain  signal. 

Calculation  of  image  features.  We  used  the  global  information  from  all  pixels  in  the  ROI  and  three  tex¬ 
ture  matrices:  cooccurrence  matrix,  gray  level  run  length  matrix,  and  neighborhood  gray- tone  difference  matrix. 
All  the  pixels  in  the  selected  ROI  were  analyzed  to  give  values  for  the  global  maximum  pixel  (IntensitymflX),  mini¬ 
mum  pixel  (Intensitym/n),  and  mean  pixel  value  and  standard  deviation  (Intensitymefln  &  Intensity  stdeviation).  We 
also  calculated  skewness  and  kurtosis  from  the  global  pixel  histogram.  The  pixels  in  the  ROI  are  then  resampled 
giving  each  pixel  P  a  value  using: 


,  x  ,  I(x)  —  min^o  i 

P(x)  =  2s - — - ^ - 

maxien  -  minien  +  1  (2) 

where  2s  represents  the  number  of  discrete  values  (32  in  our  case),  I  is  the  original  intensity  of  that  pixel,  and  O  is 
the  set  of  pixels  in  the  ROI. 

Now  we  computed  the  cooccurrence  matrix  (Ml)  using: 


MAx,A y&j) 


p= ip=i,0,  otherwise 


and  I  (p  +  Ax,  q  +  Ay)  =  j 


(3) 


where  MAxAy(i,j)  is  the  zth  and  jth  entry  in  the  cooccurrence  matrix  parametrized  by  an  offset  (Ax,  Ay)  of  an  n 
by  m  image.  We  used  the  graycomatrix  function  of  Matlab  and  chose  to  calculate  the  cooccurrence  matrix  along 
4  directions  of  distance  1  and  average  the  4  matrices  to  get  a  single  cooccurence  matrix.  We  calculate  three  image 
features  from  this  matrix: 

Angular  Second  Moment: 


/,  =  XXWm)]2 

*  J 


(4) 


Correlation: 


Contrast: 


k 


j)  -  fix/j,y 


(5) 


(6) 


The  next  texture  matrix  we  compute  is  the  gray  level  run  length  matrix  (M2)39,40,51.  We  used  the  routine  (http:// 
www.mathworks.com/matlabcentral/fileexchange/17482-gray-level-run-length-matrix-toolbox/content/GLRL/ 
grayrlmatrix.mgrayrlmatrix.m)  provided  by  Xunkai  Wei  for  Matlab52.  The  matrix  element  (i,  j)  specifies  the  num¬ 
ber  of  times  that  the  picture  contains  a  run  of  length  j,  in  the  given  direction,  consisting  of  points  having  gray 
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level  i.  We  calculate  the  matrix  for  runs  in  all  for  directions.  The  1 1  extracted  image  features  are  well  described 
in  ref.  53. 

The  last  matrix  we  use  is  the  neighborhood  gray-tone  difference  matrix  (M3)38,54,  which  is  actually  a  column 
vector  and  calculated  by  evaluating  Ap  for  a  pixel  p  with  coordinates  (k,  1)  for  a  square  neighborhood  of  size  d 
using 


Ap=A(k,  l ) 


1 


(2 d  +  ir  -  i 


X)  £  /(fc  +  »J,  /  -f  n) 


n=—dn=—d 


where  ( m ,  n)  ^  (0,  0) 


The  matrix  is  then  calculated  by 


M(i) 


y\i-Ap\,  if  there  is  a  pixel  with  gray— tone  i 

peNi 

0,  otherwise 


where  Nt  is  the  pixel  with  gray  tone  i.  The  calculated  two  features  are: 
Contrast: 


(7) 


(8) 


4 


L£*(0 


(9) 


where  Gh  is  the  largest  gray-tone  in  the  ROI  and  pt  =  \N\ln  and  n  =  (widthROI  —  2d)  (height ROI  —  2d).  Ng  is  the 
number  of  different  gray- tones  present  in  the  image. 


Calculation  of  image  features.  After  calculating  all  21  image  features  for  at  least  two  ROIs,  we  use  auto¬ 
mated  clustering  of  the  ROIs  using  the  Z- score  of  the  features,  which  is  calculated  from  the  average  and  standard 
deviation  of  the  values  of  a  specific  feature  across  all  ROIs  in  the  analysis.  The  Z-scores  are  clustered  into  two 
clusters  along  rows  (features),  then  columns  (ROIs)  based  on  their  Euclidian  distance.  We  used  the  clustergam 
routine  in  Matlab  to  generate  the  clustergams. 
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